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Abstract 

The list update problem is a classical online problem, with an optimal competi- 
tive ratio that is still open, known to be somewhere between 1.5 and 1.6. An algo- 
rithm with competitive ratio 1.6, the smallest known to date, is COMB, a randomized 
combination of BIT and TIMESTAMP(O). This and many other known algorithms, 
like MTF, are projective in the sense that they can be defined by looking only at any 
pair of list items at a time. Projectivity simplifies both the description of the algo- 
rithm and its analysis, and so far seems to be the only way to define a good online 
algorithm for lists of arbitrary length. In this paper we characterize all projective list 
update algorithms and show that their competitive ratio is never smaller than 1.6 in 
the partial cost model. Therefore, COMB is a best possible projective algorithm in 
this model. 
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1 Introduction 



The list update problem is an online problem in the area of self-organizing data structures 
(si. Requests to items in an unsorted linear list must be served by accessing the requested 
item. We assume the partial cost model where accessing the iih. item in the list incurs a 
cost of i — 1 units. This is simpler to analyze than the original /m// cost model [10] where 
that cost is i. The goal is to keep access costs small by rearranging the items in the list. 
After an item has been requested, it may be moved free of charge closer to the front of the 
list. This is called a/ree exchange. Any other exchange of two consecutive items in the 
list incurs cost one and is called a paid exchange. 

An online algorithm must serve the sequence a of requests one item at a time, without 
knowledge of future requests. An optimum offline algorithm knows the entire sequence a 
in advance and can serve it with minimum cost OPT((t). If the online algorithm serves a 
with cost A(cr), then it is called c-competitive if for a suitable constant b 

A((t) < c- OPT((t) + b (1) 

for all request sequences a and all initial list states. The constant c is also called the 
competitive ratio. If the above inequality holds even for 6 = 0, the algorithm A is called 
strictly c-competitive. 

The move-to-front rule MTF, for example, which moves each item to the front of 
the list after it has been requested, is strictly 2-competitive [[TOl [TTIl . This is also the 
best possible competitiveness for any deterministic online algorithm for the list update 
problem [fTO| . Another 2-competitive deterministic algorithm is TS, which is the simplest 
member of the TIME STAMP class due to Albers TS moves the requested item x in 
front of all items which have been requested at most once since the last request to x. 

As shown first by Irani |l9l, randomized algorithms can perform better on average. 
Such an algorithm is called c-competitive if 

E[A{a)] < €■ OPT(cr) +6, 

for all a and all initial list states, where the expectation is taken over the randomized 
choices of the online algorithm. The best randomized list update algorithm known 
to date is the 1.6-competitive algorithm COMB [i2J. It serves the request sequence with 
probability 4/5 using the algorithm BIT |[TOl. With probability 1/5, COMB treats the 
request sequence using TS. 

Lower bounds for the competitive ratio of randomized algorithms are harder to find; 
the first nontrivial bounds are due to Karp and Raghavan, see the remark in [fTOll . In the 
partial cost model, a lower bound of 1.5 is easy to find as only two items are needed. Tela 
[[T2I generalized this idea to prove the same bound in the full cost model, which requires 
long lists. The authors [6] showed a lower bound of 1.50084 (improved to 1.50115 in 
BH p. 38]) for lists with five items in the partial cost model, using game trees and a 
modification of Teia's approach. The optimal competitive ratio for the list update problem 
(in the partial cost model) is therefore between 1.50115 and 1.6, but the true value is as 
yet unknown. 
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Our results. With the exception of Irani's algorithm SPLIT f9], all the specific list 
update algorithms mentioned above are projective, meaning that the relative order of any 
two items x and y in the list after a request sequence a only depends on the initial list state 
and the requests to x and y in a. The simplest example of a projective algorithm is MTF. 
In order to determine whether x is in front of y after a, all that matters is whether the last 
request to x was before the last request to y. The requests to other items are irrelevant. 

A simple example of a non-projective algorithm is TRANSPOSE, which moves the 
requested item just one position further to the front. 

The main result of this paper is a proof that 1.6 is the best possible competitive ratio 
attainable by a projective algorithm. As a tool, we develop an explicit characterization of 
deterministic projective algorithms. 

These results are significant in two respects. First, they show that the successful ap- 
proach of combining existing projective algorithms to obtain improved ones has reached 
its limit with the development of the COMB algorithm. New and better algorithms (if they 
exist) have to be non-projective, and must derive from new, yet to be discovered, design 
principles. 

Second, the characterization of projective algorithms is a step forward in understand- 
ing the structural properties of list update algorithms. With this characterization, the 
largest and so far most significant class of algorithms appears in a new, unified way. 

The complete characterization of projective algorithms turns out to be rather involved. 
However, there is a simple subclass of projective algorithms which already covers all rea- 
sonable projective algorithms. We call them critical request algorithms. A list update 
algorithm is completely described by the list state after a request sequence a has been 
served, without specifying the particular rearrangement of items after each request; this 
can be done since we can assume that all changes in the list state are due to paid ex- 
changes, as explained in further detail at the beginning of the next section. For critical 
request algorithms, the unary projections to individual items suffice to describe that list 
state. For a request sequence a and list item x, deleting all requests to other items defines 
the unary projection a^, which is an i-fold repetition of requests to x, written as x\ for 
some i > 0. In Section 5 it will be necessary to consider unary projections x° and y° of 
length zero as different if the items x and y are different; for the moment, this distinction 
does not matter. With L as the set of list items, let the set of these unary projections be 

U = {x' \ X e L, i>0}. (2) 

Definition 1 (Critical request algorithm). 

A deterministic critical request algorithm is defined by a function 

F : U ^ {0,1,2,. . .}, with F{x') < i for any x e L. 

We call the F(ax)th request to x in cr the critical request to x. If F^a^) is zero (for 
example if ax is the empty sequence 0), then x has no critical request. In the list state 
after a, all items with a critical request are grouped together in front of the items without 
critical request. The items with critical requests are ordered according to the time of the 
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F(a^)th request to x in a. The later a critical request took place in the sequence, the closer 
the item is to the front. The items without critical request are placed at the end of the list 
according to their order in the initial sequence. A randomized critical request algorithm 
is a probability distribution on the set of deterministic critical request algorithms. 

As an example, consider the online algorithm for three items a, h, and c with the 
function F shown in the following table for requests up to four items. 
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In the rest of this paper, list states are written as [xiX2 ■ ■ ■ x„] where xi is the item at the 
front of the list. Let the initial list state be [abc]. Consider the list state after a = abbcab. 
We have F{aa) = F{aa) = 0, hence a does not have a critical request. For b we have 
F{(^b) = F{bbb) = 2, therefore the second request to 6 in a is its critical request. For c we 
have F{ac) = F{c) = 1. Thus after a, the list state is [cba]. If we augment a by another 
request to a, item a moves to the front, because its critical request is the second. 

Algorithms based on critical request functions are clearly projective, since the relative 
order of any pair of items just depends on the relative order of the requests to x and y in 
a and the relative order of x and y in the initial list state. 

In good online algorithms, the critical requests are very recent, like in MTF which is 
described by the critical request function = i for all items x. We define the critical 

request relative to the current position by 

f{x') = z-F{x'), (3) 

from which the critical request function is recovered as = i — /(x*). Then MTF is 

given by /(x*) = 0. Algorithm TS is described by /(x*) = 1 for all items and alH > 
(and /(0) = 0). Because the BIT algorithm [10] is randomized, its critical requests are 
also randomized. For every item x, its relative critical request function can be written as 
/(0) = and, for t > 0, 

f{x') = {b, + i) mod 2 (4) 

where b^ G {0, 1} is chosen once uniformly at random. Hence the critical request is the 
last or the second-to-last request with equal probability. 

The structure of the paper is as follows. In the next section, we explain projective 
algorithms in more detail and how they can be analyzed. In Section 3, we give a char- 
acterization of Af -regular projective algorithms, followed by the lower bound of 1.6 for 
this class of algorithms in Section 4. In Section 5, we characterize projective algorithms 
completely. We extend the lower bound to the full class in Section 6. 
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2 Projective Algorithms 



In order to characterize list update algorithms, we first simplify their formal definition. 
The standard definition (of the partial cost model) considers a list state and a sequence of 
requests. For each request to one of the items to the list, the item can be accessed with 
access cost z — 1 if the item is in position i, and then moved free of charge closer to the 
front. In addition, paid exchanges are allowed which can be applied both before and after 
accessing the item, at a cost of one unit for exchanging any two consecutive items. 

Contrary to the claim of [fTTl Theorem 3], paid exchanges may strictly improve costs. 
For example, let the initial list state be [ahc\ and o = cbbc. Then an optimal algorithm 
moves a behind b and c before the first request to c. This requires paid exchanges. 

On the other hand, free exchanges can be mimicked by paid exchanges as follows: 
Instead of first paying k units in order to access item x and then moving it at no charge 
t positions closer to the front, one can first move the item t positions forward and then 
access the item. In both cases, one pays exactly k units. 

Furthermore, one can restrict paid exchanges to take place just before the access to 
a requested item. This holds because after accessing an item, one can postpone paid 
exchanges until the next request is revealed. 

The above considerations lead to a simplified but still equivalent model of list update 
algorithms. With the simplified model, we can specify any deterministic online algorithm 
A by a function 

Here, S denotes the set of finite request sequences, whereas C denotes the set of the n\ 
states the list of n items can attain. By definition, S^{a) denotes the list state after the 
last request of a has been served by algorithm A. 

Consider a request sequence a and assume it is followed by a request to item x, the 
extended sequence denoted by ax. Then the cost of serving request x is defined by: the 
cost of re-arranging the list from state S^i^cx) to S^{ax) by paid exchanges, plus the cost 
of accessing x in state S^{crx). 

Using this notation, the initial list state can be denoted by 5*^(0). We will omit the 
superscript A in S^{a) when the algorithm used is determined by the context. 

In order to describe projective algorithms, we have to introduce the concept of pro- 
jections of request sequences and list states. Let a request sequence a be given and fix a 
pair of items x, y. The projection axy of a to a; and y is the request sequence a where all 
requests which are not to a; or ?/ are removed. Similarly, is a with all requests other 
than X removed. 

Given a list state L, the projection to x and y is obtained by removing all items except 
for X and y from the list. This is denoted by L^y. 

Definition 2. Let Sxy{(j) be the projection of S{a) to x and y. A deterministic algorithm 
A is called projective if for all pairs of items x, y and all request sequences a 

Sxyicf) = Sxyi^Cxy) ■ (5) 
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A randomized algorithm is projective if all deterministic algorithms that it chooses with 
positive probability are projective. 

Thus, an algorithm is projective if the relative position of any pair of items depends 
only on the initial list state and the requests to x and y in the request sequence. 

Projective algorithms have a natural generalization, where the relative order of any k- 
tuple of list items depends only on the requests to these k items. It turns out that for lists 
with more than k items, only projective algorithms satisfy this condition. This follows 
from the fact that, for example for A; = 3, S^y^{cr) = S^y^{axyz) (so the relative position 
of X and y does not depend on requests to w), and S^y.^{a) = S^y^la^yuj) (so the relative 
position of x and y does not depend on z), which implies that Sxy{(j) depends only on 

Already in |I71, Bentley and McGeoch observed that MTF is projective: Item x is in 
front of y if and only if y has not been requested yet or if the last request to x took place 
after the last request to y. 

With the exception of Irani 's SPLIT algorithm [9J, projective algorithms are the only 
family of algorithms that have been analyzed so far, typically using the following theorem, 
for example in BHHIll. 

Theorem 3. If a (strictly) projective algorithm is c-competitive on lists with two items, 
then it is also (strictly) c-competitive on lists of arbitrary length. 

Proof. Consider first an arbitrary list update algorithm A. We define the projected cost 
Axy{cr) that A serves a request sequence a, projected to the pair x, y, as follows: Let a'z 
be any prefix of a. Then A.j.y{a) is the number of times, for all requests z in a, where 
Sxy{a') and S^y^a'z) differ (which counts the necessary paid exchanges of x and y; this 
may happen even if z ^ {x,y} in case A is not projective), plus the number of times 
where z = x and Sxy{(j'z) = [yx] or z = y and Sxy{(j'z) = [xy]. Let L be the set of list 
items. Then 



because the costs a((t) are given by the update costs for changing S'(cr') to S{o-'z), which 
is the sum of the costs of paid exchanges of pairs of items, plus the cost of accessing z in 
states (a'z). 

For a projective algorithm A the relative behavior of a pair of items is, according 
to dl]), independent of the requests to other items. It is therefore easy to see that A^j,(cr) = 
^xyicTxy) for projcctivc algorithms: Because A is projective, A^y^axy) is also the cost of A 
for serving a^y on the two-item list containing x and y starting from Sxy{^). 

For the algorithm OPT, one can interpret OPTxyio'xy) as the cost of optimally serving 
axy on the two-item list Sxy{^). To see this, note that in order to serve a optimally, one 
can always start by moving the items not requested in a to the tail of the list, without 
changing their relative order. Concerning OPT, we have OPT^y(o") > OPTxyio'xy)- Then 




(6) 



{x,y}CL 




(7) 



{x,y}CL 



{x,y}CL 



6 



Let A be a projective algorithm that is r-competitive on two items. Then for every pair 
of items x, y there is a constant h^y such that for all a 

^xy{,^xy) — ^ ' ^^^xy{,^xy^ ~t~ ^xy 

Then 

{x,y}CL 

< J2 OPT ^y{a^y)+b^y) 

{x,y}CL 

< c ■ OPT(a) + b,,y 

{x,y}CL 
= C • OPT(cr) + b 

< c-opt((7) + 6. 

For the strict case, just set all bxy :— 0. □ 

Not all algorithms are projective. Let LMTF be the algorithm that moves the requested 
item X in front of all items which have not been requested since the previous request to x, 

if there has been such a request. 

It is easy to prove that on lists with two items, combining LMTF and MTF with equal 
probability would lead to a 1.5 -competitive randomized algorithm. Obviously, if LMTF 
was projective, this bound would hold for lists of arbitrary length. 

However, LMTF is not projective. This can be seen from the request sequence a — 
6aac6c with initial list Lo = [abc\. It holds that 5'-'-''^^^ (ex) = ca6, whereas 5'-'^'^^^ (cTbc) = 
S^^'^^ibcbc) = bca. Hence S^f^^ia) ^ St^'^^{a,,). 
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3 Critical Requests and M-regular Algorithms 

In this section, we consider deterministic projective list update algorithms. In order to 
refer to the individual requests to an item x, we write unary projections as 

X' = X^i)X(2) ■ ■ ■ X^i), 

that is, is the gth request to a; in ci if ax = x\ for 1 < q < i. 

Let 'P(cr) be the set of all permuations of the sequence a. In particular, V{x^y^) 
consists of all sequences with i requests to x and j requests to y. 

Swapping two requests X(g) and ?/(/) in a request sequence a means that X(^g) and y(i), 
which are assumed to be adjacent, change their position in a. If two requests are not 
adjacent, they cannot be swapped. 

Definition 4. A pair of unary projections x\ y^ is called agile if there exist two request 

sequences r and r' in V{x^y^) with S^yir) = [xy] and S^yir') = [yx]. 

Definition 5. We call a pair of requests x^q), y(^i) an agile pair of a if and y(^i^ are 
adjacent in a and swapping and in a changes Sxyicr). 

Clearly, if and y^ are agile, then there exists an agile pair in at least one sequence 
belonging to V{x''y^). 

Lemma 6. If x^q), y(i) is an agile pair of cr, then x and y are adjacent in S{a). 

Proof. Let a' be a with X(^q) and ?/(/) swapped. Clearly, Sxy{cr) ^ Sxy{cr') and Ssticr) = 
S'sj(cr') holds for all {s,t} C L except {x,y}. But this is possible only if x and y are 
adjacent in S'(cr). □ 

Definition 7. For every x^ E U let i?(a;*) be the set defined as follows: X(^q) G -R(x*) if 
and only if there exists y^i) and a such that xi^q) , y^i) is an agile pair in a. 

Lemma 8. If both pairs x*, y^ and x'\ are agile, then = 1. 

Proof. Obviously, _R(x*) > 0. Suppose that _R(x*) > 1; we will show that this leads to 
a contradiction. If _R(x*) > 1 then there exists r G V{x^y^) with an agile pair X(^q),y(^iy 
Similarly, there exists a sequence A G V{x^z^) with an agile pair X(q'), and q ^ q' . 
By suitably inserting k requests to z into r, we create a sequence a with a^y = r and 
Cxz = A in which both X(^q),y(i) and Z{m) are adjacent pairs. 

By ([5]), swapping the agile pair X(^q),y(i) will change Sxyio), but leave the relative 
order of the pairs of items unchanged. The same holds for the agile pair X(q'), z^m) and the 
pair X, z. 

Lemma [6] enforces x to be adjacent to both y and z in S{a). By swapping X(q),y{i), 
we obtain a sequence a' in which X(g/), Z{^rn) is still an agile pair, but x and 2 are no longer 
adjacent in S{a'), which contradicts Lemma[6l □ 
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Lemma 9. If X(^q),y{i) is an agile pair in A G V{x^y^) and \R{x^)\ = 1 and \R{y^)\ = 1, 
then swapping X(g) and changes Sxy{cr) in any sequence a G V{x^y^) where 
and y{i) are adjacent. 

Proof. |i?(a;*) | = 1 and |-R(?/-') | = 1 implies that the only swap of requests that can change 
the relative order of x and ?/ in a request sequence is swapping and y{i). If the lemma 
does not hold, there exists a sequence in o in which we can swap X(q) and y{i) to obtain 
a' with Sxy{(y) = Sxy{cr'). Then we can obtain any sequence in V{a) by successively 
transposing adjacent requests, starting from either a or a', without ever swapping X(q) and 
y(i). Thus, the relative order of x and y would be the same for all request sequences. But 
we know that swapping and y{i) changes Sxy{\)- This is a contradiction. □ 

In this and the next section, we consider online list update algorithms that move an 
item to the front of the list after sufficiently many consecutive requests to that item. This 
behavior is certainly expected for algorithms with a small competitive ratio. In this sec- 
tion, we show that such algorithms, which we call Af -regular, can be characterized in 
terms of "critical requests". In the next section, we use this characterization to show that 
such algorithms are at best 1.6-competitive. 

Definition 10. For a given integer M > 0, a deterministic algorithm is called M-regular 
if for each item x and each request sequence a, item x is in front of all other items after 
the sequence ax^ . 

A randomized algorithm is called M-regular if it is a probability distribution over 
deterministic M-regular algorithms. 

The algorithms discussed at the end of the introduction are all 1 -regular or 2-regular. 
A projective algorithm that is not Af -regular is FREQUENCY COUNT, which maintains 
the items sorted according to decreasing number of past requests; two items which have 
been requested equally often are ordered by recency of their last request, like in MTF. 
Hence, after serving the request sequence x^'^^^y^'^, item x is still in front of y, which 
shows that FREQUENCY COUNT is not M-regular for any M. Algorithms that are not 
M-regular are characterized in Section 5 below, but such "irregular" behavior must vanish 
in the long run for any algorithm with a good competitive ratio (see Section 6). Hence, 
the important projective algorithms are M-regular. 

The following theorem asserts the existence of critical requests, essentially the unique 
element of in Lemma [H for those unary projections where this lemma applies. 

For projectivity, the list items may also be maintained in reverse order, described as case 
(b) in the following theorem; competitive algorithms do not behave like this, as we will 
show later. 

Theorem 11. Let A be a deterministic projective algorithm over a set L of list items. 
Then there exists a function 

F -.U ^N, F{x') < i for all i 

so that the following holds: 
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Let Q be a set of unary projections containing unary projections to at least three dif- 
ferent items. Let all unary projections to different items in Q be pairwise agile. Then one 
of the following two cases (a) or (b) applies. 

(a) For all pairs of unary projections x^,y^ from Q it holds that if g = and 
/ = F{y^), then 

S (a) = I ^^^^ ^^^^ requested after in a 
\ [vA if ^(g) is requested before y(i) in a 

(b) For all pairs of unary projections x'\y^ from Q it holds that if g = and 
/ = F{y^), then 

g (a) - I ^^^^ ^^"^ requested before in a 
1 [yx] if is requested after y^i^ in a 

Proof. Since all pairs of unary projections in Q are pairwise agile, we can conclude 
\R{x^)\ = 1 for all x^ e Q hy Lemma [8l This allows us to define F(x^) = q if 
X(q) G R{x^). From Lemma|9]we can conclude that for every pair x\ y\ either ([8]) or (|9l) 
holds. 

It remains to prove that either all pairs are operated by ([8]) or by (|9l). If this was not 
the case, then it would be a possible to construct a sequence a which has a pair of critical 
requests adjacent to each other in a without the corresponding items being adjacent in 
S{a), which contradicts Lemma [6l □ 

The following theorem asserts that an M-regular algorithm operates, after M or more 
requests to a items in a list with at least three items, according to critical requests as in 
Definition[T] That is, case (b) of TheoremdH where the list items are arranged backwards, 
does not apply. 

Theorem 12. Let A be a deterministic projective M-regular algorithm over a set L of at 
least three list items. Then there exists a function 

F -.U ^N, F{x') < i for all i 

so that the following holds. Let x,y E L. Let a be any request sequence with \ax\ > M 
and \ay \ > M. Then 



[xy] if X(^q) is requested after in a 
[yx] if X(^q) is requested before in a 



Proof. Let Q be the set of all unary projections with i > M. This set has the 
all the properties of the set Q in Theorem \TT\ where clearly case (a) applies because 

S,y{x^'y'') = [yx]. □ 
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4 The Lower Bound for M-regular Algorithms 



In this section, we use Theorem [TT] to prove the following result. 

Theorem 13. No M-regular projective algorithm is better than 1.6 -competitive. 

We first give an outline of the proof. Given any e > and b, we will show that there 
is a probability distribution vr on a finite set A of request sequences so that 

y ^(^) — ^7^-^ > - ^, (10) 

^ '0PT(A) + 6 - 



for any deterministic M-regular algorithm A. Then Yao 's theorem [[T3B asserts that also 
any randomized M-regular algorithm has competitive ratio 1.6 — e or larger. This holds 
for any e > 0, so the competitive ratio is at least 1.6. This ratio is achieved by COMB, and 
therefore 1.6 is a tight bound for the competitive ratio of M -regular algorithms. 

All A G A will consist only of requests to two items x and y. In what follows, let 
M > M and M > 3 and let the request sequence cf) be 

:= yx^' y^' xy""' x^' yxyx^' y^' xyxy^ . (11) 

Let K and T be positive integers and let H be the number of requests to x (and to y) in 0, 
that is, 

if := 101/2 = 4M + 4. (12) 
Then the set A of sequences in (flOl) is given by 

A = k{K, T) := {a;*^+*/^+'^0^ \ 0<h<H,0<t< HT}, (13) 

where tt chooses any A in A with equal probability 7r(A) = 1/H'^T. 

OPT pays exactly ten units for each repetition of (which always starts in offline list 
state [yx]). Assuming that also the initial list state is [yx], all sequences in A have offline 
cost lOi^' + 2. This and the fact that 7r(A) for A G A is constant allows us to show (flOl) 
once we can prove 

A(A) > IQKH^T - o{KH^T). (14) 



aga 



because then 



V (\) ^^^^ = Eaga A(A) ^ IGKH^T - o{KH^T) ^ ^ 
^ ^^0PT(A) + 6 Eaga(0PT(A) + 6) - {lQK + 2 + b)H^T " ' 

for K and T large enough. 

Definition 14. A request sequence cr ends at state if \ax\ = i and \ay\ = j. The 
request sequence A passes state if there is a proper prefix a of A, with X = ar for 
non-empty r, so that a ends at (i, j). The request in A after (i, j) is the first request in r. 
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Definition 15. Let A\{i,j) denote the online cost of serving the request in A after 
If A does not pass \etAx{i,j) = 0. 

Definition 16. A state is called good if for every proper prefix a of (p (that is, 
< |cr| < 2H) there is exactly one A G A so that a prefix x^'^^^y^'^^'^cp'^a of A ends at 

After proving that good states incur large costs in Lemma \\2\ we will only need to 
prove that almost all states are good to complete the proof of Theorem [T3l 

Lemma 17. Let be a good state. Then 

AeA 

Proof. Consider any A G A. We can assume that A passes (otherwise Ax{i,j) = 
0). The request in A after is some request in (f). The cost Ax{i,j) of serving that 
request depends on whether the requested item a; or y is in front or not. This, in turn, is 
determined by the terms /(x*) and f{y^) as defined in ([3]), which determine the relative 
critical requests to x and y in \ (recall that the item with the more recent critical request 
is in front). 

Because (i, j) is a good state, we obtain exactly all the requests in as the requests 
after in A when considering all A in A that pass Therefore, the total cost 

^;^g^AA(i,j) is the cost of serving exactly the requests in according to the critical 
requests as given by /(x*) and f{y^). 



fix') 


f{y') 








^yM 




yxyx'^ 




xyxy^^ 










1.. 


11.. 


1.. 


11.. 


1.. 


1111.. 


1.. 


nil.. 
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1.. 


11.. 
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1.. 


101.. 


11.. 


11011.. 


>16 


1 


1 


11.. 


1.. 


11.. 


1.. 


11.. 


1011.. 


11.. 


1011.. 


16 


1 


>2 


11.. 


1.. 


111.. 


1.. 


11.. 


101.. 


111.. 


10111.. 


>18 


>2 


>2 


111.. 


1.. 


111.. 


1.. 


111.. 


101.. 


111.. 


101.. 


>18 



Table 1: Online costs Ax{i,j) for all A that pass a good state which are the costs of 
serving the requests in 0. They depend on the relative critical requests /(x*) and f{y^). 

The rows in Table [U show the costs Ax{i,j) for the possible combinations of /(x*) 
and f{y^), up to symmetry in x and y. For example, consider the first case /(x*) = 
and /(?/"') = 0, where the critical request to an item is always the most recent request to 
that item. Suppose that the request after is the first request, to x, in the subsequence 
xy^^ of 0. The critical request to x is the last request to x earlier in yx^\ and the critical 
request to y is the last request to y earlier (and more recent) in y^. The critical request 
to y is later than that to x, so y is in front of x, and serving x incurs cost 1, which is the 



12 



first 1 in the table entry 11.. in the column for xy . The second 1 in 11.. is the cost of 
serving the first y. It is 1 because here the critical request to x is more recent than the 
critical request to y. The in 11.. correspond to the costs of later requests to y in y^' , 
which are zero for /(x*) = and f{y^) = (so for M = 4 the complete cost sequence 
would be 11000). In a good state, each cost or 1 in the table (in correspondence to the 
respective position in (p) is incurred by a sequence A in A. 

By construction of A, the requests before x^^ in the first column of Table [T] are of the 
form y^^, so y is in front of x, and the first request of x^^ has always cost 1. 

In the second row in Table [H /(a;*) = and f{y^) > 1. As an illustration of a 
more complicated case, consider the subsequence xyxy'^^ of (p in the last column, with 
associated costs 11011... The first 1 is the cost of serving the first request to x, because 
the preceding requests are M > M requests to y in y^'^ and because the algorithm is 
M-regular, which means f{y^) < M, so y is in front of x. Because /(x*) = 0, the cost of 
serving the first y in xyxy^ is also 1, because x is in front of y. The second request to x 
has cost (the first in 11011..) because y is not moved in front of x (the critical request 
to y is earlier than that to x because f{y^) > 1). The next two costs 11 are for the second 
and third request to y in xyxy^' , because the critical request to x is more recent. 

The rows in Table [H describe all possible cases for /(x*) and f{y^), because the costs 
for requests to x and y apply in the same manner when x and y are interchanged. The 
respective costs in Table [Hare easily verified. The right column shows that the total cost 
J2xeA ^a(^) j) is at least 16 in all these cases, which proves the claim. □ 

Proof of Theorem [73] We only have to prove (fT4l) . Because of Lemma [TTl it suffices to 
show that the number of good states is at least 

KH'^T - o{KH^T). 

By Definition [T6l state is good if for every proper prefix a of (p there exist unique 
k, h, t with < A; < A", < /i < if and < t < ifT so that x^^^^y^^+^cp^a ends in 
(i, j). This is equivalent to 

i = M j^t + kH +\aj\, 
j = M + h + kH + \ay\, 

or equivalently 

t = i + h-j-{\(r^\-\ay\), ^^^^ 

h + kH = j-M-\ay\. 

For < k < K and < h < H, the term h + kH takes the values 0, . . . , KH - 1. 
The second equation in (fTSi) therefore has a unique solution in h, k, for any a (where 
< \ay\ < H) whenever M + H- l<j<M + KH. Because < \a^\ - \oy\ < H, 
the first equation in (fT5l) has a unique solution t in {0, ... , HT — 1} if j + H — l<i< 
j + HT — H, for every fixed j. Hence the number of good states is at least 

{KH -H + 1)- {HT -2H + 1) = KH'^T - o{KH^T). □ 
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5 The Full Characterization 



In this section, we give the full characterization of deterministic projective algorithms. 
We consider the set U of unary projections of request sequences defined in (O as the set 
of nodes of the directed graph G = (f/, E) with arcs {x\ y^) in E whenever there is a 
request sequence a in V{x'-y^) with S{a) = [xy]. 

For any two distinct items x and y and any i,j > 0, there is at least one arc between 
X* and y^ . If the pair x\ y^ is agile according to Definition |4l then there are arcs in both 
directions. Only pairs of nodes of the form x\ x^ do not have arcs between them. 

Let W be the set of strongly connected components of G, and let C (x*) be the strongly 
connected component that belongs to. We think of C(x*) as a "container" that contains 
X* and all other unary projections y^ with C{y^) = C(x*). 

There exists a total order < on these containers so that C(x*) < C{y^) if Sxyicr) = 
[xy] after serving any a E V{x^y^). To see this, we define the following binary relation P 
on W: Let C(x*) PC{y^) if there is a path in G from x* to yK Then P defines a partial 
order on W. The only pairs of containers which are not ordered in P are those of the form 
{x*}, {x^ } for which there does not exist a container C(?/'') withC(x*) < C{y'') < C{x^) 
or C{x^) < C{y'^) < C(x*). By stipulating {x*} < {x-'} if and only if z < j for such 
pairs, we can extend P to the desired total order <. 

An easy case are the empty unary projections x° for items x: Note that x° and y^ are 
never in the same container because there is only a single sequence a in V{x^y^) which 
determines Sxy{o-) uniquely, so there cannot be paths in both directions between x° and y^ 
in G. Hence C(x°) = {x°}, and C(x°) < C(?/°) if and only if x is in front of y in the 
initial list. 

In summary, for a request sequence a, the total order < on W determines the list 
order between two items x and y whose unary projections and ay belong to different 
containers in W. 

If ax and ay belong to the same container, then the list order between x and y can be 
described by essentially two possibilities. First, if the container contains only projections 
to at most two items x and y, nothing further can be said because the algorithm is trivially 
projective with respect to x and y; the set of these containers will be denoted by W2. 

Second, if a container contains unary projections for three or more distinct items, then 
the algorithm's behavior can be described by critical requests similar to Theorem [TTl the 
set of such containers will be denoted by W+. There is a symmetric set W" where the 
algorithm behaves in the same manner but with the list order reversed (which does not 
define competitive algorithms). 

These assertions are summarized in the following theorem. 

Theorem 18. Consider a deterministic projective list update algorithm. Then there are 
pairwise disjoint sets W+, W^, W2 whose union is W and a total order < on W and a 
function C : U W with 

(I) C(xO) = {x°} G W2 for all x G L. 
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(II) for any three items x, ?/, z, if C(x*) = C{y^) = C{z^) = w, then w ^ W2. 

Furthermore, if C(s*) ^ W2, then there exists F{x^) G {!,...,«} with the following 
properties: For all request sequences a with ax = and ay = y\ 

(III) if < C{yi) then S,,((t) = [xy]; 

(IVa) if = C{y^) e W+ then 5^j,((t) = [xy] if and only if the F(x*)th request to x 

is after the F(?/-')th request to y in cr; 

(IVb) iiC{x') = C{y^) G then 5^j,((t) = [xy] if and only if the F(x*)th request to x 
is before the F(?/-' )th request to ?/ in cr. 

Proof. The set W and the order < have been defined above with the help of the graph G, 
which shows (III). We have also shown (I) above. 

As before, let W2 be the set of containers with unary projections to at most two distinct 
items, which implies (II). 

It remains to show (IVa) and (IVb). Consider a request sequence a with ax = x^ 
and ay = y^ . Let C{x^) = C{y^) ^ W2, so that there is a third item z ^ {x,y} with 
C(x*) = C{y^) = C{z''). We want to apply Lemma[8l To this end, we first show: 

{x\y^)eE and {y\z'')eE =^ {x\z^)eE. (16) 

Let (x*, y^) E E, so that Sxy{a) = [xy] for some a E V{x^y^). If {y\ z^) E E, then one 
can insert k requests to z into a so that Syz{a) = [yz]. Adding the requests to z does not 
change Sxy{a), so S{a) = [xyz], which implies {x\ z^) E E. This shows (fT6l) . 

With the help of (fT6l) . we now show that if C (x*) = C (y^), then the pair a;\ y^ is agile 
according to Definition HI We will prove this by showing that 

{x\y^)EE and {y^,x')EE. (17) 

To prove (fTTl ). recall that C(x*) is a strongly connected component of the graph G which 
also contains y^ and z''. Therefore there exists a path in G from to y^ via z''. This path 
is a sequence of unary projections mi, . . . , u„ with uq = x\ ui = z^ for some 1 < I < n, 
and Un = y-' ■ Let Sj be the item of the corresponding unary projection u\ in particular 
So = x,si = z, Sn = y. 

We call a path ui . . .Un between x* and y^ valid if . . . , s„}| > 3. We claim that 
if there exists a valid path between x* and y^ of length n > 3, then there also exists a valid 
path of length n — 1. 

To show this claim, consider the smallest q so that Sq, and s^+i are three distinct 
items. Because of (fT6l) , clearly Sg+i) E E. If the path mi . . . m„ remains valid after 

removing Uq, we are done. 

Otherwise, clearly . . . ,s„}| = 3, and q = 2 because otherwise Sq = S2 and 
one could remove U2. We consider the two cases n = A and n > A. If n = 4, then 
si, . . . , S4 must be of the form a, 6, c, S4 and it is easy to see that S4 {a, 6, c}. Hence 
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this case cannot occur. If n > 4, then si, . . . , s„ is of the form a, 6, c, a, c, . . . and one can 
apply (fT6l) in order to remove U3 and still get a valid path. This shows the claim. 

It follows from the claim that there is a valid path of length two between and y^. A 
final application of (fT6l) then gives {x\ y^) E E. The same argument shows (?/•', x*) G E. 
This proves (fTTl) . 

Because all pairs of unary projections are agile in C(x*), we can apply Theorem [TTl 
whose cases (a) and (b) prove (IVa) and (IVb). This proves the theorem. □ 



6 The Lower Bound for Irregular Algorithms 

In Section HI we showed that no deterministic M-regular projective list update algorithm 
can be better than 1.6-competitive. For this we gave, for any £ > 0, a suitable distribution 
on request sequences that bound the competitive ratio of the algorithm from below by 
1.6 

We extend this analysis to arbitrary randomized projective list update algorithms using 
the full characterization from the previous section. 

In brief, the proof works as follows. Using the crucial notion of a good state (z, j) in 
Definition [T6l we call a deterministic algorithm M-regular in state if it fulfills a cer- 
tain condition, (fTSl ) below, where the algorithm only uses the containers from Theorem [T8] 
in the normal way that one expects from competitive algorithms. The lower bound from 
Lemma[l7]applies in expectation for algorithms that fulfill condition (fTSi) . If the condition 
fails, we can give simple request sequences that show that the randomized algorithm is not 
1.6-competitive, so the old analysis and the lower bound 1.6 — e do apply in expectation. 

Theorem 19. Any randomized projective list update algorithm that accesses a list of at 
least three items is at best 1.6-competitive. 

Proof. Assume the list has at least three items. Consider a randomized projective algo- 
rithm A and assume that A is c-competitive with c < 1.6. That is, there exists a constant 
b such that A{a) < c ■ OPT((t) + b for all request sequences a. 

We adapt the proof for M-regular algorithms of Section |4l Let M > 3, consider A in 
(fT3l) and consider a good state as defined in Definition [T6l 

Let A be a deterministic projective algorithm. We say that algorithm A is M-regular 
in state if, with as in Theorem [T8l 

Cix')=Ciy^)eW+, fix')<M, f{y')<M. (18) 

It is easy to see that the proof of Lemma [17] applies if A is M -regular in (i, j). 

Recall that A is just a probability distribution on the set of deterministic projective 
algorithms. Let be the event that A is M-regular in state («, j). Then in a good state 
(i, j), then the expected cost of A is bounded as follows: 



E 



Laga 



> 16 •prob(rij). (19) 
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Analogous to the analysis for M -regular deterministic algorithms, generalizing inequality 
(fT4l) . the right-hand side of (US) fulfills 

^ lQY>^oh{rij)>KH^T-o{KH^T)- ^ 16(1 - prob(r,j)). (20) 

good good 

Let X := H{K + T) + M and y := KH + M. For all good states (i, j) we have 

1 < i < X and 1 < J < r. (21) 
If we can prove that, with growing M, K, and T, 

Y X 

16(1 - prob(rij)) < 5^ 5Z ^^(^ " Prob(rij)) = o{KH^T), (22) 

(i j) good j=l i=l 



then we have proved ([Ml) for irregular algorithms. This can be done by analyzing where 
(fTSi) fails, that is, for each of the six cases according to 



Y X Y X 

^ ^ 1 - prob(rij) < XI 5Z 

j=l 1=1 j=l i=l 



( prob(C(xO < C{y^)) \ 
+ prob(C(xO > C{y^)) 
+ prob((:7(xO = C{y^) G W") 
+ prob(C(xO = C{y^) G W2) 
+ prob(C(xO = Cd/-') G W+, /(x*) > M) 
y +prob(C(xO = C(i/-') G W+, /(y^) > M) y 

We start by proving 

Y X 

5^Xprob(C(xO < C{y^)) < o{KH'T). (23) 

i=i i=i 

To this aim, consider the sequence x*?/^ for 1 < i < X. When serving this sequence, 
a request to y will be served in each of the states (i, 1), (i, 2), . . . , {i, Y). Since every 
deterministic algorithm with C(x*) < (^(y-') pays one unit for accessing y in state 
the expected cost of A for serving a request to y in a state is at least prob(C(x*) < 
C{y^)). Therefore 

Y 

A{xY) > Ywoh{C{x') < C{y^)). (24) 

i=i 

On the other hand, it must hold that A{x''y'^) < c ■ OPT(a;*?/^) + b because A is c- 
competitive. Since OP 1(2;*?/^) = 1 it follows that 

X Y X 

Yl P^°^ (^^^*) < ^^^^)) - Yl ^(^^y^) < X ■ (c + 6) = o{KH^T). (25) 
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The bound on prob(C(x*) > C{y^)) is very similar. 

For prob(C(x*) = C{y^) G W"), we also use request sequences of the form a = 
x^y^ . Clearly, from the first request to y on, the critical requests to x is always earlier in 
cr than the critical request to y. Therefore C(s*) = C{y^) E implies that y is behind 
X in the list. 

If = C{y^) E W2, the container C(x*) does not contain any unary projections 

to items other than x or y. The list has at least a third item z and either C(x') < C{z'') 
or C{z^) < for any k. We consider only the first case, where we can bound 

prob(C(x*) < C{z'^)) similarly to (l23l) . By considering the request sequence x^z^ for 
1 < i < X, we obtain in the same way as with (|24l) and (|25|) that Ylii=i -^{x^z^) = 



Woh{C{x') = Ciy^) E W2) < prob(C(xO < C{z^)) + pToh{C{x') > C{z^)) 



for all z'^ with z ^ x,y. Hence the left hand side can be bounded by the bound on the first 



o{KH^T). 



We have 



two cases. 

In a similar fashion, we bound prob(C(a;*) = C{y^) E W^, /(s*) > M): 



Y X 



5^ 5^prob(C(xO = Ciy^) E W+, f{x') > M) 



j=i i=i 



= Prob(C(xO = C{y^) E W+, fix') >M) + 



j=i i=i 

Y X 



E P^ohiCix') = C{y^) E W+, f{x') > M) 



i=i i=M 



Y X M-1 



< + ^ 5Z 5Z prob(C(x'+0 = C{y^) E W+, f{x'+') > M) 
j=i ^ i=i e=o 




< 



Fix(c-0PT(xyx*^) + 6) 



o{KH^T). 



The bound on prob(C(a;^) = C{y^) E W 



1+ 



/(?/•') > M) is similar to the previous 



bound. 



□ 
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7 Conclusion 



An open problem is to extend the lower bound to the full cost model, even though this 
model is not very natural in connection with projective algorithms. This would require 
request sequences over arbitrarily many items, and it is not clear whether an approach 
similar to the one given here can work. 

Another ambitious goal is to further improve the lower bound in case of non-projective 
algorithms. Here, the techniques of the paper do not apply at all, and to get improvements 
that are substantially larger than the ones obtainable with the methods of (611 requires new 
insights. 

Finally, the search for good non-projective algorithms has become an issue with our 
result. Irani's SPLIT algorithm [9] is the only one known of this kind with a competitive 
ratio below 2. A major obstacle for finding such algorithms is the difficulty of their anal- 
ysis, because pairwise methods are not applicable, and other methods (e.g. the potential 
function method) have not been studied in depth. We hope that our result can stimulate 
further research in this direction. 
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